TOOL FOR MAPPING VIDEO ANNOTATIONS TO CONCEPTS IN AN ONTOLOGY 
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LEARNING DATA PREPARATION COMPONENT PREPARES 
LEARNING INSTANCES 
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IINDEX GENERATES RELEVANT STATISTICS (tf, idf, cf) AND 
CREATES INVERTED INDEX 
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RETRIEVER LOOKS AT NEW ANNOTATIONS AND USES THE 
INVERTED INDEX TO RETRIEVE AND RANK MOST 
RELEVANT NODES FOR THESE ANNOTATIONS 
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FIGURE 2 



LOOKING AT DATA DERIVED FROM PAST MAPPINGS OF 
ANNOTATIONS AND CAPTIONS TO ONTOLOGY, 
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FUSING ALL ANNOTATIONS THAT ARE MAPPED INTO THE SAME NODE 
IN THE ONTOLOGY INTO A LEARNING INSTANCE FOR THAT NODE. 
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FIGURE 3 



IDENTIFY 

TERM FREQUENCY //, 
INVERSE DOCUMENT FREQUENCY idf, 
TERM FREQUENCY tf ifi 
DOCUMENT FREQUENCY dfi 
400 



0 

m 

m 
m 
m 

IB 

Si 

o 
m 
m 
y> 

o 



I 



IDENTIFY CONTRIBUTION FREQUENCY cf 
IDENTIFY TOTAL NUMBER OF ANNOTATIONS tc 
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CALCULATE wt_cf 

cf 

wt_cf = (0.5 + -^-)(1.0- 
tc 
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FIGURE 4 



CALCULATE CONTRIBUTION OF THE TERM FREQUENCY TO THE WEIGHT OF A 

QUERY TERM 



Normalized _tf.. = 0.4 + 0.6 x 



logGf,+0.5) 



log(max_(/\ + 1) 
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CALCULATE INVERSE DOCUMENT FREQUENCY NORMALIZED BY THE 
TOTAL NUMBER OF DOCUMENTS 



idf. = ii- 
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WEIGHT CONTRIBUTED TO A PARTICULAR CATEGORY IN THE ONTOLOGY BY 
THE OCCURRENCE OF WORD / IN LEARNING VECTOR j 

wt = (0.4 + 0.6 x Normalized _ tf v xidfj ) xwt _ cf 
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FIGURE 6 
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ANNOTATE MULTIMEDIA SEGMENT 
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AUTOMATICALLY MAP TO AP 

7] 


PROPRIATE NODE ONTOLOGY 

L4 




r 


INTEGRATE OTHER RELATED CONTENT (THAT ARE MAPPED TO THE SAME NODE 
IN THE ONTOLOGY) WITHIN THE MULTIMEDIA SEGMENT 

m. 



FIGURE 7 



